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A B S TP. ACT 

This paper focuses on the methodology of cross group 
comparisons of rearessior. coefficients commonly used to identify 
group differences in status attainment. Using the study of race 
differences in educational attainment as an example, the paFe^ 
reviews a number of relevant published studies and demonstrates that 
evidence for such differences is inconsistent across studies, that 
differences ir. the regression coefficients are subject to artifactual 
scurces of fluctuation, and that statistical inferences based on such 
differences are weak. The paper concludes that the study of 
statistical interactions requires the design of creative studies and 
da*a collection strategies that anticipate and compensate fcr such j 
problems as inadequate data, differential measurement ttoperties, anu 
differences in the sampling frame. (MJL) 
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Introductory Statement 



The Center for Social Organization of Schools has two primary objectives: t;c 
develop a scientific knowledge of how schools affect their students, and to 
use this knowledge to develop better school practices and organization. 

The Center wjorks through five programs to achieve its objectives. The 
Studies in School Desegregation program applies the basic theories of social 
organization of schools to study the internal conditions of desegregated 
schools, the feasibility of alternative desegregation policies, and the inter- 
relations of school desegregation with other equity issues such as housing 
end job desegregation. The School Organization program is currently concerned 
with authority-control structures, task structures, reward systems, and peer 
group processes in schools. It has produced a large-scale study of the effects 
of open schools, has developed Student Team Learning Instructional processes 
for teaching various subjects in elementary and secondary schools, and has 
produced a computerized system for school-wide attendance monitoring. The 
Scho ol Process and Career Development program is studying transitions from 
high school to post secondary institutions and- the role of schooling in the 
development of caieer plans and the actualization! of labor market outcomes. 
The Studies in Delinquency and School Environments program is examining 
the interaction of school environments, school experiences, and individual 
characteristics in relation to in-school and later-life delinquency. 

The Center also supports a Fellowships in Education Research program that 
provides opportunities for talented young researchers to conduct and publish 
significant research, and to encourage the participation of women and 
minorities in research on education. 

This report, prepared by the Schpc 1 Processes and Caieer Development program, 
examines sohe methodological problems involved in the study of black-white 
differences in the educational attainment process, 
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Abstract 

Differences in the status attainment process for groups are often 
inferred from differences in corresponding regression coefficients when 
structural equations models are separately estimated for each group. 
This paper examines the credibility of inferences based on cross- 
group comparisons of regression coefficients using black-white dif- 
ferences in the educational attainment process as an example. It 
'reviews evidence ibout race differences from previous studies and 
finds inconsistencies. Reanalyses of the data from these studies 
using common models and methods fails to produce consistent results. 
Additional reason for caution in substantive interpretation of dif- 
ferences in regression coefficients is illustrated using NLS data 
in which a large portion of the subgroup differences in regression 
coefficients can easily be interpreted as due to black-white differences 
in the measurement properties of the observed variables. Other sources 
of regression slope flitrtuaHor that may arise from methodological 
rather than substantive processes are also illustrated. Evidence 
implies that regression slope differences across groups in models of 
attainment provide ambiguous evidence on which to base statements about 
differences in the attainment process. 
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In 1980, five of the twenty-nine articles published in the Ameri^ 
Sociological Review used cross-group comparisons of regression coeffi- 
cients as evidence for differences between groups in some social process, 
usually status attainm2nt. This paper focuses on the methodology com- 
nonly used to identify such group differences j^ the stat us attainment 
tradition. Using the study of race differences in educational attain- 
ment as aft example, it demonstrates that evidence for such differences 
.is inconsistent across studies, that'dif fercnces in the regression 
coefficients are subject to many artif actual sources of fluctuation, 
and that statistical inferences based on such differences »re weak at 
best. 

The availability of data and amount of previous research determined 
the choice of groups used to develop the theme of this paper. Only 
comparative studies of the educational attainment of blackfand white 
maies were sufficiently abundant to allow for a sensib^cross study 
comparison. I will begin with a brief review of th«j relevent status 
attainment literature. 

Duncan's (1968) analysis of the Occupational Change in a Generation 
(OCG) data provided a landmark for subsequent analyses of racial inequality 
In the status attainment process. That study suggested that the problen 
of racial inequality is twofold: Blacks enter the occupational structure 
with an initial disadvantage (i.e., the mean level of socioeconomic status 
of parents is lower for blacks than for whites), and blacks do not get 
as high a return for their resources <i.e., the regression slope of 
attainment on background factors is not as steep for blacks as for whites). 
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Duncan implicitly used black-«hite co^arisons of regression coefficients 
and intercepts as evidence that even if blacks were to enter the labor 
force with the same "advantage" as whites they, would nevertheless end up 
in lower prestige orations and with lower earnings as a result of 
"occupational discrimination" (p. 108), 

A decade of modification, elaboration and replication of Duncan's 
,„odel and findings aimed at understanding the mechanisms of inequality 
has ensued. Attempts to specify in what ways the educational process 
differs for blacks and whites have elaborated Duncan's model to include 
mea sures of noncognitive socialization variables such as self-esteem and 
conformity (Porter, 1974; Portes and Wilson, 1976) as well as allocation 
variables such as curriculum placement (Thomas, 1980). Interpretations of 
race differences in regression coefficients for the models have ranged from 
socialization to allocation explanations (Kerckhoff, 1976). Socialization 
explanation, assume that (a) certain nonintellective skills or access to 
.nformaUon'promote future attainments, and that (b) individuals or groups 
whose socialization experiences have been deficient in training for these 
skills lack these personal characteristics that would enable them to 
"work the system," i.e., to translate certain resources into rewards. 
Allocation explanations assume that individuals are assigned to social 
statuses partly on the basis of race and that attainment depends nut on 
earned merit but on membership in an elite status. 

These elaborations of the Blau-Duncan model have clarified some 
issues with regard to the interactions of race with other variables in 
the educational attainment model, but have also raised new questions tr t 
remain unanswered. Duncan's observation that the regression coefficients 
for blacks are in general lower than for whites has been replicated 
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several times, but the specific differences between coefficients have 

appeared only inconsistently across studies. 

The literature on race differences in regression slopes is extensive 

but lackino in integration. Because the studies reviewed differ in 

roany ways, direct comparisons of their results are usually inappropriate. 

Differences across studies may resuU from cohort or time differences be- 
cause the data were collected at different times (base years range from 
1960 to 1977).' Other major differences in the characteristics of the 
subjects across studies include age (grade of subject at first contact 
ranges from 8th to 12th) and geographic region (most samples are not 
nationally i resentative) . Also, sample^sizes often make comparison of 
regression slopes within and across studies tenuous when regression 
coefficients are compared without appropriate consideration of the 

. sampling errors for the coefficients, as is often the case. 



Table 1 About Here 



Table 1 summarizes sample characteristics and the authors' interpre- 
tation of which coefficients differed for blacks and whites, I will 
verbally summarize the authors' interpretations of these differences for 
only a few of the studies. This summary should serve to familiarize the 
reader with common interpretations of the differences in regression slopes. 
See Gottfredson (1980) for a more detailed review of these studies. 

Porter (1974) interpreted racial differences in magnitudes of coef- 
ficients across groups (reported in Table 1) and relative weights within 
groups (not reported here) according to Turner's (i960) distinction 
between Pontes f and "sponsored" mobility. For blacks, conformity, an 
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expression of a middle-class world view, is encouraged by significant 
others in the socialization process, but ambition— measured by aspirations 
and expectations for a prestigious career — is not. Black educational 
attainment is more dependent on conformity than it is on ambition. Con- 
versely, whites are socialized to be ambitious as well as to conform to 
middle-class norms, but their attainment is more dependent upon ambition 
than it is upon conformity. Porter interpreted the absence of a direct 
effect of intelligence and significant others* influence on grades and 
of grades on educational attainment for blacks as suggesting that the 
sponsored mobility of blacks depends on being chosen, not upon performance. 

Portes and Wilson (1976) interpreted results of their study as 
implying that the earlier variables in the model— socioeconomic status, 
mental ability, and academic performance— were stronger predictors of 
attainment for white* than for blacks. But the mediating variables— self- 
esteem and educational aspirations— were more important or equally impor- 
tant for blacks. The authors interpreted these findings to mean that "for 
the (white) majority academic grades, apart from psychological effects, 
appear to 'carry along' individuals toward predictable levels of achievement. 
Black grades, especially those from all-black schools, appear to be more 
irrelevant as marks of achievement within the schools themselves and as 
criteria of selection for higher education" (p. 429). Later (p. 430) 
they concluded that blacks move upward primarily through individual self- 
reliance and ambition while whites have at their disposal an additional 
set of "institutional machinery" which can carry them along despite 
*ub p'c t ivo or ientat ions. 
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Kerrkhoff and Campbell (1977b) reported that the weakness of the 
status attainment model for blacks is attributable to the limited effett 
of SES of origin on educational outcomes, to the lack of consistency/of 
academic performance for blacks, and to the greater importance for blacks 
of non-academic performance (staying out of trouble in school) relative 
to academic performance. They interpreted these findings as being con- 
sistent with Porter's (1974) notions about sponsored and contest mobility 
systems. Teachers promote or sponsor those blacks who have few disciplinary 
problems and not necessarily those who perform well academically . These 
conclusions are based in large part on the following findings: A model 
including a measure of disciplinary problems and two measures of grade 
point average (one from junior and one from senior high school) predicted 
educational attainment better for blacks than for whites. Measures of 
status background variables had no significant direct effects on any out- 
come for blacks with the exception of a direct effect of mother's educa- 
tion on early grade point average. Grades in senior high school were more 
predictable from grades in junior high school for whites than blacks, and 
a measure of disciplinary problems was more important than a measure of 
grad, point average for explaining blacks' attainment while the reverse 
order of effects was observed in the whito equation. 

No croK-,-„tudy agreement exists a.j.na specific race differences in 
the paiarm-Lers of this model ol educational attainment. Maior discrepun- 
cies bevond tho'.p which are obvious from Tabic 1 exist anions the studies. 
Win-reds Porr.s and Wilson (1976) found educational expectations to be a 
strong predictor of attainment for blacks, Kerrkhof and Campbell (1977b) 
found no efteit of aspirations on attainment lor blacks. While both 
Portes and Wilson (197b), and Porter (197«) t found school pe r formance 
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to be insignificant for explain* attainment for blacks, Kerckhoff and 
Campbell (1977b) found that senior high school CPA was the only variable 

1 level of significance *ar blacks. 

whose coetticient teci<_ii«-u ^..v ,- 

Other discrepances involve the de .minants of educational expectations. 
S ,o studies Ulout and Morgan. 1975; Kerckhoff and Campbell, 1977b> 

, n^rformin-e but not mental ability, was predictive 
minlied that academic per f orman. i , 

.« udnctlcnal expectation, for bl.,OK „ale s . In «*«.«. M«<. «."«. 
.,„d Cl«. (1977) found achoo, performance to be significant for all group- 
ie bUdf «,.« an. t„0 effect of *»„. t. be fo. black 
aI „. Simla, dlscr-parolc; ex.s. with reran! to the Influence of slgnl- 
£lc .,„t others. Studio* that combined the .octrees of Inllucncc found no 
, 1(K1 for b.ac^a.e, on their educational expectations. Hout and Mor B a„ 

r ,11 , r «uT but Piack males, and parental encourage- 
found peer eftects for all group., nai 

t . r, r ,i. ,rouns, but thev were strongest for black males. (They 

, , lh , lir „„ CPA effect as an indication of .. strong teacher 
also interpreted the largt 

ri . w . PC effect for bl.uk m.il>.s.) DeBord, Coffin and Clark found 

W All three influences were significant for blacks, 
almost the opposite. mi !•"*«■ 

m „. fr ,,n nurents was muea more predictive of educational 
hut encour "foment rr«',n |»u-»<- 

,1 l. Kimllv the onlv difference 
, ,„, t ,Kions for whites than lor blacks. finally, 

lhl . appeared wrth anv eons.st nev across studies- that academi, porCor- 
nint , l, more important for predicting the edueatronal attainment of white, 
man blacks-was d iseon f i rmcd by Ihouas' study. 

IU s.iWinjL Dij't' rrnu- towi Jii u >lil' s 
Jeueks et al. Uo 7 9) ro,Hlv demounted, differences in results 
h .„,d on different surveys mav ,-su„ from a nwrtad o* seeminglv arbitrnrv 
aeHsions that must he p...- 'w h..,., individual researches and -urvev 
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organizations. Differences in sampling frame, measurement procedures, 
attrition and categorization of data cause means, standard deviations 
and associations among the same variable* to di'fei Ciuu, auive, to Suiv«y. 
At the level of the individual researcher, choice of population, definition 
ot variables, sending and transformation of variables and treatment of 
missing data arc among the decisions that affect research results. Reseach- 
ers are seldom aware of the ways in which "seemingly innocuous 'procedural' 
or 'methodological' decisions affect outcomes." (p. 289). The conclusion 
reached by Jencks et al. after investigating survey differences in depth 
is that "surveys agree well on the bread, general picture, but detailed 
interpretations must still be treated with some caution." (p. 282). 

-Several major sampling and procedural differences among the studies 
reviewed are likely causes of their discrepant results. Several sub- 
samnle analyses of blacks are based on extremely small samples resulting in 
inetficient regression coefficients. Differences in the constructs 
included in the causal models on which the equations are based, in the 
particular operational measures usee -he constructs and in their 

measurement reliabilities affect resul-.s. The use of different, often 
incorrect, criteria for identifying cross-race differences in regression 
coefficients in the various studies is another reason for the failure to 
replicate, as is the use of statistics which assume ra..uom observations 
with nonrandom samples. These sampling characteristics and procedural 
d\cision-, affect the values of regression coefficients and i ntroduce* oi se 
into comparisons of those coefficients. The remainder of this paper 
illustrates some possible consequences of these methodological sources 
of fluctuation for making substantive interpretations of repression slope 
differences. 

M 
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A difference interpreted as substantively meaningful in one study 
may be regarded as noise in another. T*e variety of criteria used in 

f _ „ CCA rs -I r^ys t- ^ fforonroQ 

the studies reviewed for identifying re.TO.wu .o...~ 

inpUes that the Choice of an appropriate statistic is not always obvious. 
« least si, different criteria were usee In the seven studies reviewed 

. . t .. at t h P difference between the black 
h ere: One study required t,.at t. e 

and white coefficients exceed one standard error of Che white coefficient; 
another retired that it exceed 1.5 standard errors of the Mac. coeffi- 
ci , nt . n~. study used a t-te S t to determine whether the difference 
could have arisen as a result of random fluctuation, given the white 
coefficients as population values. One used an F-test to see whether 
adding an interaction tern for race a given variable added signifi- 

cant to tne variance explained in the criterion. One study chose an 
ar K< t rary value and required the difference between the standardized 
regression coefficients for Maexs and whites to exceed it before being 
considered important, and another sinply used the "eyebail" method for 

detecting differences. 

Standard statistical texts discuss appropriate technics for 
identifying regression coefficient difference.,. Kerllnger and Pedhazur 
(»». aanter O and lianusho, and daemon (1977 , Chapter 4) suggest the 
„, of interaction terns computed by nultiplving the grouping variab!e 
(ln this case race, by the predictor of interest. The statistical 
sl „„ lfl cance of the interaction tern can he assessed with a t-statiatic to 
test the n„U hypothesis that the interaction t™'. coefficient (if only 
„„c torn is being tested, enuai.s zero, „t with an P-stat i stlc to teat the 
„„!, hypothesis that adding the interaction torn to t nuntion adds 
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nothing to the explained variance of the criterion. Another appropriate 
statistical teat of the null hypothesis of equal slopes is a t-iest for 
random variables with unequal variances. 1 

!„ all hut one of the studies reviewed, the criteria used fo, 
identifying differences in coefficients was 1~ stringent the., is appro- 
priate, resulting in the rejection of the null hvpothesis of no difference 
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Bopartures from randomness in the sampling designs for surveys add 
another source of nuisance fluctuation to regression coefficients when the 
sampling characteristics are not tahto into account in the analysts 
st ,„ e m particular, aonindependenoe of observations (impiying unequal 
or correlated error variance across observations, hla.es the resuUs o, 
,tandard statistical tests h y counter, standard error* to ho undorost,- 
mated and, again, too often Reccing the null hypothesis of no differ- 
ence. The sampling designs for both the Youth in Transition and the 
National Longitudinal Surveys, two large-scale national samples used in 
the studies reviewed,- were multi-stage cluster designs resulting In 
nonindependence of observations. 

Table 2 About Here 

A simple demonstration of the consequences of violating the non- 
independence assumption is illustrated in Table 2. This table shows 
proportions of variance explained by addit.»< models and models including 
race interaction terms for each equation Implied bv the Wisconsin model 
of status attainment. Data are from the Youth In Transition Project 
(Bachman, 1975). See Appendix A for descriptive data on the observed 

1G 
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measures. The significance level of increments to explained variance 
of the interaction model over the additive model are tested with an 
F-test. 

Global F-tests like these are, of course, not useful for testing 
hypotheses about specific interact i-ms-they merelv alert the researcher 
to the possibility of an interaction with one or more of the variables 
in the equation. Such tests are found frequently in comparative status 
attainment studies, and yield results simila- in terms of magnitude of 
increments to those in the top panel of Table 2. 

Th-_ oottom panel of Table 2 shows parallel mfc.r-.ar ion for incre- 
ments due to interactions with random variables. Ml whites in the 
YIT sample (N=1912) were assigned a random grouping variable so that 
seven nonover lapping groups with a«s ranging fro. 23- & 289 could be 
identified and the significance of interaction t-rns computed using 
these random grouping variables >" ...•.'.•♦'I. 

The table shows that increments due to th. random interaction 
terms often are larger thin those due U nr. i nterac t ioiu. . Clear lv, 
using me standard F-test is i nappmpr iat- with these "data. The test 

h„„U reiect the null hvpothesi. (that additt -, of the inter- 

action terns does not increase the predict ton of tie criterion) in 1.75 
of the 35 random tests at the .05 level and .3', tin- at the .01 level. 
Instead it is rejected lh Limes at to 



')•, 1 , v. 1 and l > tines at the .01 



1 eve I . 

Cms — nr.iup comparison, of spe< if i- r-en s-lh, rooft i« lents u. n« a 

, t , in ,,, rd ,-ro! (see footnote 1) Vie Id .quutlv que tumble results. 

efficients estimated for random -Jute ,.»•> -m,,-. d.ve.-.e ran'- or mot". 

17 
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from the values estimated for the full white sample than do those esti- 
mated for the black subsample. Clearly, the use of standard statistical 
tests with these data yield misleading results. 

It is sometime possible to adjust for heterogeneity of error variance 
using techniques familiar to statisticians. Generalized least squares 
(Uanushek and Jackson, 1977, Chapter 6) is one such technique; design 
effect s (a measure of the extent to which standard statistical-formulas 
underestimate actual standard errors) are another. Bachman, O'Malley 
and Johnston (1077, Appendix B) provide approximations for standard 
errors adjusted for nonindependence using a design effect that was 
calculated Cor the entire Youth in Transition sample. They chose not, 
however, to provide a design effect that could be used for the black 
subsample, mere the P roble„ of nonindependence is much more severe 
(over two-third, of the blacks are located in only ei ? ht of the 87 

schools sampled) . 

The original investigators of the Youth in Transition data have 
consistently and repeatedly discouraged the study of race differences 
using these data b." cause the general i zabil Ity of results from the black 
S ubsnm P le is severely limited. Differences within the black subsample 
bas,d on difierences in school and community environments are great, 
and the likelihood is high that observed differences between the blacks 
ln th o sample and other subgroups result from school differences rather 
tnan race differences because the blacks are clustered in only a few, 
primarily segregated schools. 

Solely to illustrate the need for adjusting for nonindependence 
of observations before applying standard statistical tests when using 
the Youth in Transition data, I used Bachman et al.'s design effect to 
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adjust the standard errors of regression coefficients for the tod white, 
blatk, and random white subgroups In the exercise described above. When^ 
the t-tests are repeated after making this correction, .cost differences 
between coefficients for the total white and all orner grouP^are reduced 
to nonsi^nificance. 
~\ The preceding paragraphs Illustrate an obvious point: The 

searcher's decision about how to test for the presence of group dif- 
ferences in regression coefficients has serious consciences for the 
studv . B conclusions, and the problem is worse when data do not abide 
bv the alliens required b y standard statistical tests. The choice 
of an appropriate statistic Is not aiuays obvious, though. Had I 
adopted the criteria for identifying race differences in regression 
coefficients used in the studies reviewed earlier, I wouid have con- 
cl uded that aubstantively interesting race difference, exist. Instead 
t concfude that the observed differences are, by and large, due to the 
^efficiency of the sample for calculating precise estates. 

r „ree ,a;or possible sources of diacrcoancico -on, the studies 
„d~s n aU subset si.es resulting in inefficient regressfon 

i „,i c *nd different methods for Identifying 
weights, different causal models and ditter 

, , iscuSS ed In an effort to uncover cross-study 
differences— hive been discussed. 

consistencies by controUing for these .a,or differences, 1 reanalyzed 
dat a fro. oniy those .tudiea based on subtle, of at Uast two hundred 
cases using a co^on causa! .odd and method for identifying regression 



2 

coefficient differences 



Rcr . r esa,nn, were conputed separately for each race group using the 
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entailed excluding variables such as "conf ormity to middle-class norms" 
and "self-esteem" which are unique to one or another study. Also, for 
those studies that used disaggregated measures of some of t£e model's 
constructs (Debord, Griffin and Clark, 1977; Thomas, 1980), I included 
all measures as indicators of the constructs in the Wisconsin model (LISREL 
was used for all reanalyses) . Multiple indicators were used for the 
Significant Others' Influence construct— reports by teachers, peers and 
parents were ^vil.-blc — and the Socioeconomic Status construct—mersurcs 

of parents' education, fathers' occupation and (in Thomas only) a Household 

3 

Index were use^ , 

Because the reanalyzes are based on published correlation matrices, 
it is not possible to follow the procedures suggested by Kerling, r and 
Pedhazur (1973) or Hanushck and Jackson (1977) to test for statistically 
significant increments to explained variance in the criterion due to the 
interaction terms. Instead, I chose to test the null hypothesis that the 
regression coefficients for the black and white subsamples are equal (in 
each study) with a t-statistic for random variables with unequal variances. 

This is not an entirely appropriate test. It does not explicitly 
correct for the nonhomogeneity of variance across observations caused by 
the cluster sampling designs used in many of the studies, although the 
use of separate variance estimates for blacks and whites helps somewhat 
to offset this problem to the extent that Macks and whites are highly 
' segregated in schools (which is the case at least in the Youth in Transi- 
tion data). This test is also flawed because it assumes that each test 
is independent nf other tests, which is not the case because the values of 
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the regression coefficients in a given equation are not independent. 
Despite these problems, I considered it to-be acceptable for the present 
task, which is to apply a uniform criterion for identifying coefficient 

differences to the results of several studies rather than to learn about 

actual race differences in regression coefficients. 
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Table 3 summarizes the results of the reanalyses of four studies. 
Little consistency emerges in the results. Some of the differences renorted 
in the original studies ire not upheld in the reanalysis. All but one 
of the reported differences in the effects of SES are no longer signi- 
ficant. Four of the seven differences found are not replicated, i.e., 
are found in only one study. The effect of Aptitude on Level of Educa- 
tional Aspirations was found to differ by race in two of the three studies 
including that test, but the direction of the "advantage" was different 
in each study. The two remaining differences, Aptitude on Academic Per- 
formance, appearing in three of the four reanalyses, and Academic Per- 
formance on Significant Others' Influence, appearing in two of the studies, 
all indicate a larger effect for whites than for blacks. 

IU-1 iabilit" . V iliditv and Inter preting Slope Difference s 

1 have sc far shown that in general, specific black-white regression 
slope differences do not replicate across studies. This finding consti- 
tutes sufficient reason for pause interpreting the observed differences 
in terms of substantively meaningful proc, ,ses. Yet, even if we could 
place confidence in the observed regression coefficient differences, other 
alternative hypotheses *mus t be eliminated before the researcher entertains 
a substantive explanation. 
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Imperfect measurement of constructs constitutes another source of 
variation in regression slopes. Regression coefficients are biased 

downward to the extent that the constructs they purport to describe are 
invalidly measured. Differences across groups in the construct validity 
of measures can render comparisons of their regression coefficients 
useless. For example, if we wish to -determine the effect of investing 
in vocational preparation on later income, and choose to measure the 
investment by the number of years of college completed, we are likely to 
observe a larger regression coefficient for academics than for machinists. 
One possible explanation for this is that machinists do not experience 
as high a :ate of return on their investments as do academics. An alter- 
native and more plausible interpretation is that the construct—investment 
in vocational preparation— is not validly measured by college attendance 
for machinists and that the regression coefficient for that group is 
biased downward. 

B^elby, Hauser, and Featherman (1977) investigated the consequences 
of ignoring differential measurement error across groups, They used 
retrospective data on socioeconomic background and self-reports of 
educational attainment collected at three points in time, systematically 

^ried the specification of the measurement properties for each group 
and examined the fit of the data to each model. They found more measure- 
ment unreliability among the black than the white subsampie, and that 
ignoring measurement error led to misinterpretations of their data. 

To illustrate the consequences of different specifications of the 
measurement model for the problem at hand, 1 focus on the one black- 
white difference in the model which was replicated in more than half of 
the studies reviewed— the effect oriental Ability test scores on 
Academic Performance. 
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The data used for this demonstration are all black and white males 
who participated in the Base Year (1972) of the National Longitudinal 
Study (NLS) of the High School Senior Class of 1972. These are the same 
data used in Thomas' study except thai: the present study included the 
respondents who did not have data for the standardized mental abilities 
tests (37% of the black and 28% of the white males) and computed pairwise 
present correlation coefficients, whereas Thomas' study excluded those 
cases from all analyses. Means, standard deviations and correlations for 
those data appear in Appendix A. 

The point of this exercise is to demonstrate the effect of various 
ways of dealing with imperfect measurement on conclusions about race dif- 
ferences in regression coefficients, Measurement models were developed 
for most constructs in the Wisconsin model using multiple indicators 
available in the NLS data. 2y nanipul at -i.g equality constraints across 
black and white subgroups 4 for segments of the model (measurement and 
structural)^ it is possible to assess the relative goodness of fit of 
the differentials. Differences between the black and white coeffi- 
cients for the variables in the equation predicting academic performance 
are also examined for the various specifications. 

Model A in Table 4 estimates the parameters for the model shown in 
Figure 1 separately for each of the race subsamples. This model fits the 

data better (v 2 = 1450, df - 41) than Model D, which treats the two 
' V D-C 

populations as though they were from a single population. This implies 
that at least some element of the model differs fron. the two groups. 
Models B and C are attempts to narrow down the possible locations of 



Figure 1 and Table 4 About Here 



the differences.. Model B constrains all structural coefficients (those 
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marked with a solid line in Figure l) to be equal for the black and white 
subsamples and allows the measurement coefficients (marked with dotted 
lines in Figure 1; to be estimated separately for each group. Model C 
reverses that procedure. Relaxing the equality constraints on the mea- 
surement model (Modei B) improves the model's fit (over Model D) more 
( x 2 = 1382, df = 27) than does relaxing the equality constraints of tae 

structural parameters (over Model D) ( X 2 = df = 21). In other words, 

D-C 

allowing only the measurement of the constructs to vary across groups 
accounts for 95% of the difference between the best and worst fitting 
models, while allowing only rhe structural coefficient, to vary accounts 
for only 31% of that difference. This implies that the fundamental models 
differ less across race than do the reliabilities of the measures. 

Recall from Panel A of Table 3 that Thomas' analysis of the NTS 
data which specifies perfecc measurement of the constructs implied that 
the effect of mental ability on academic performance is greater for 
whites than for blacks. Results based on the models in Table 4, all of 
which allow for imperfect measurement, should be contrasted to that 
finding. 

The regression coefficients reported in Table 4 show that once esti- 
mates are "corrected" for differential measurement reliability (Model 
t he oft-observed black-white difference in the effect of Mental Ability 
on Academic Performance disa^ ears. Only when the model forces all black- 
white difference in the correlations of the observed variables to be repre^ 
sented in the structural coefficients (Model C) does Lt reappear. 

The conclusion to be drawn from this illustration is not new. 
Social scientists have been aware of the effects of imperfect measurement 
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on the value of regression coefficients for decades. Yet typical research 
in this area has neither corrected regression coefficient differences for 
the effects of differential reliability in order to get cleaner estimates j- 
(as textbooks such as Cohen and Cohen, 1975, suggest they should), nor 

5 

investigated the sources of differential measurement error across groups. 
The conclusion, once again, is that race differences in regression coeffi- 
cients have, been overstated in previous research. 

Summary and Concl tision 
I have presented evidence from a variety of sources that converges 
on the conclusion that substantive inferences about race differences in 
the educational attainment process are unwarranted on the basis of 
diffcrencesJLn reg res si on_^oeffl cients in the published literature. 
Results of studies examining race differences in the attainment process 
over the past decade do not agree on the nature of the differences observed, 
and this conclusion is upheld even when major differences in the samples, 
models and' methods are held constant. Additional doubt is cast on 
substantive interpretations of the observed differences when a large 
portion of the observed race differences in regression coefficients i.s 

^_ jjff„ r „„Hil mo•50l,rpm^ 1 n^ nmnerties of the subsamples. 
touna to oe uuc Co uiiicruiui 

Regression slope differences in previous studies comparing structuial 
models of educational attainment for blacks and whites constitute highly 
ambiguous evidence on which to base statements about race differences 
in the educational attainment process. Much of the weakness of the 
evidence may be attributed to the inadequacy of most data used for 
answering questions about comparative status attainment. It is often 
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difficult, if not impossible, to compensate for unfortunate characteristics 
of the cample* 5 such as unreliable measurement and heterogeneity of error 
variance due to cluster sampling designs. In short, the study of 
statistical interactions requires deliberate data collection strategies 
that anticipate and compensate for problems such as differential measure- 
ment properties. Representative samples are useful for learning about 
the general picture, but most often do not provide the power needed to 
examine interactions. Designing creative studies that focus better on 
the questions to be answered holds more promise than do continuing efforts 
to squeeze precise parameter estimates from data that lack the power 
to address the questions. 
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Footnotes 



This test statistic is: 

t ~ ~~zzz. 



b, - b 
b w 



2 

J s t. err b _+ st. err w 

A correction for the degrees of freedom reflecting unequal san P le 
sizes (Hays, 1963) can also be used. Other tests are possible. 
For example, . goodness of fit of the overall^odel to the data night 
be used as the criterion for accepting or rejecting the notion of 
statistical interaction. The fit for models specifying equality 
constraints on parameters across groups can be compared to that for 
m odels which allow parameters to be estimated separate!** for each 
group. Such a test is possible with LISRKL IV (Joreskog and Sorbom, 
1978). 

Published correlation matrices, means and standard deviations were 
available for all but one of the studies included in this reanalv.is. 
The data for the study, which did not publish the nectary .^na- 
tion (Thomas, 1980) was supplied by its author. 

The choice of indicators for each of the constructs was determined 
Bole lv hv the requirement of equivalent measures across all stud.es. 
lh , intent of this exercise is to eliminate obvious differences umon 
the studies in order to uncover consistencies rather than to est.m.U 
true parameters for the status attainment model. Hence, although 
aiffer-n. specifications (such as inclusion nf other psyrholo -.lei 
variables or disaggregating significant other.' influence) are 
superior, some correctness must be sacrificed hen-. 
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This can be accomplished using LISREL TV (Joreskog and Sorbom, 1978). 
When an equality constraint for any parameter is imposed, the groups 
are analyzed simultaneously holding that parameter constant across 
the groups. 

The latter course of research seems tc be a promising approach for 
furthering our understanding of race differences in attainment. The 
m easurement differences which appear to be a nuisance in status attain- 
me nt research may tell us much about attainment. Low measurement 
reliability for the constructs in the model may indicate an unwilling- 
ness or inability tc cooperate with the researcher, or it may indicate 
that the instruments used to measure the constructs are biased. 
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Figure Caption 



v - i. ITSRFI Model of Educational Attainment. Note: Descripti.... 
2 "HguUr "<--•) <^~* una„a lyZ e„ correlations or rasrduaU. 
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Table 2 



Proportions of Variance Explained and Increments to Explained Variance due to 
Race Interactions and Random Grouping Variable Interactions 



Academic 
Performance 



Significant 
Others' 
Influence 



Criterion 



Level of 
Educational 
Aspirations 



Level of 
Occupational 
Aspirations 



Educational 
Attainment 



R" for model with no interactions 

2 

R for model with all race inter- 
actions 

Increment due to race interactions 



Increment due to 

random grouping variable 
interaction for 
group number: 



1 
2 
3 
4 
5 
6 
7 



.199 

.222 
.023** 



.000 
.001 
.002 
.001 
.000 
.001 
.000 



.133 

.140 
.007* 



.013** 

.009** 

.006* 

.004 

.000 

.003 

.000 



.198 

.206 
.008** 



.014** 

,003 

.002 

.003 

.001 

.005* 

.003 



.279 

.284 
.005 



.018** 

.003 

.003 

.003 

.005 

.013** 

.002 



.481 

.490 
.009** 



.007** 

.007** 

.012** 

.005* 

.056** 

.001 

.002 



*p ; .05 
**p< .01 
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Table 3 

Lnstandardized Regression Coefficients f-r Wisconsin Model 



Criterion Variables 



Predetermined 

Van ib lei, 



Academic 
Performance 



Significant 
Others' *nf luence 



Level of Educational 
Aspirations 



Educational 
Attainment 



Blacks Whites 



Blacks 



Whites 



Blacks 



Whites 



Blacks 



Whites 



Socieecono"iC Status 
Apt itu«e 

A^aJtnic Performance 
Significant Oilers' Influence 



Da t a.frow Porter (1974); Bla ck_N^3 5 v W hite N-14891__ 
.008* . .029 .074** 

049** .068** .074** 

.016 .282** b 



.018 
.006 



(no measure of educational expectations 

included in this study) 



.006 



.111 



.113 



,191 



Data from DeUord, 



S 'do* cor»c-:c St.uts 

,\„Jr,ic ptrfor-nance 
Significant others ' Influence 

K 2 



-.011 a 
-.155** 



,240 



Griff i n_a n d . f lark _( «J 7 71: n 1 lac k JK4 1 Q^JJh I te JNf J 0 1 4 
.076* .1^7** .082** -.023 4 

161** .002 .013* -126 

.047 .052** -059 

3.147** 

.279 .188 _ . *35 _JJLL 



.018 
-.00? b 

.181* 
6.266** b 

.653 



(no measure of 
educational attainment 
included in this study) 



OD 



Sociot c-*ncr.ic Status 
A,»titu W 

\i ud'.-h PerfornMOve 

i,mf leant Ocr trs 1 Influence 
l.wl ?f Educ^l i.nai Aspirations 



>.u i it com- i - St itu^ 
1 1 t*t !«• 

..J. -ic Perfor "'nee 
'ii .'hi f u aU ntl».rs' Inf luenrt 
Ua! ».f 1 iiicatj.*na! Aspiration* 

»ffifiunt is sijnifiiant .it the 
f uffir int is si.'nlh' «.nt at the 
S.j. | tt ... ' iwi i. ! . • -n.l whit 

j [ , > t .,, >i ' b »nd wit t ! 

c , .r.i, , • ii. f »r ihi! b ' 



Pa t a.JjronJPcrtc» Wilson . (1 97.6_1_D lar 1^*^256^ WhUe . N = L^7 

,G22 .055* .094** 

1.637** b .CM .210** a 

.C ( M* .064** 



-.041 
.499** 



Oil 
044 
046** 
055* 



.024** 

.035*b 
.018** 
.059** 



.027* 

.115* 

.026 

.034 

.452** 



,02?** 

.097** 

.062** a 

.040** 

.404* 



.056 



-.156 
428** 



.0^9 
.624*** 



C66 

n9R0) : _nl.v^k_V- 

.C29* 
.f 15* 
.C01 



-34*. 



. 186 

Whi tc 



S^47 58 



] i 



2M 



p < .0 5 level . 
P C . J 1 1 eve 1 , 

i m } f 1 ( [t O 5 

t dp[ fit Unfi 

t y<_ irs «>t the 



Is r J,. n |f h 
is s<K?.ifi< 

s i r v / , 



1M< 

Jt! t 



. 181 



nt t ho p < .05 
at the p * - ( *1 

Mm hi t 'i C £"t 



.025** 

.008** 
.0l0** b 



lev c 1 
lew 1 . 



• 1(5 I lit 



116 


;4 7 


.2 79 


_-413 


109* 


118** 


,057* 


.039*- 


128** 


092** 


.019 


.017** 


048* 


.073** 


.025* 


.022** 


0 ( H* 2 


.202"* 


. 789* 


.193** 






. jS4** 


.207** 


5 19 


,4 70 


, W8 


.'i74 


] M H'H*. were 


hasi*d were 


n-»t i'fuv j J- J 
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Table 4 



Relative Goodness of Fit and Regression Coefficients 



for 



Models of Educational Attainment Allowing for Imperfect Measurement 



Model Same 

and 
Description 



A: Wo equality 
constraints across 
groups 

B: Structural coeffi- 
cients constrained to 
be equal across groups 

C: Measurement coeffi- 
cients constrained to 
be equal across groups 

D: Structural and mea- 
surement coefficients 
constrained to be equal 
across groups 



X Goodness of 
Fit, corrected 
foi\degrees of 
freedom 



297^ 



30^2 



3977 



kh2h 



unstandardized regression 
coefficients^ 
Academic Performance on 
Socioeconomic 

Stat us Mental Ability 

Black 



Black 



White 



White 



-.017(.012) -.OlU(.OOU) .?32(-Ol8) .252(.005) 



-,015( .00h) 



-.Ol8(.0.2) -.OlU(.OOU) .17M-012) .258(.C05) 



,013( -00H) 



.2Uo(.005) 



This statistic is computed by subtracting the models' degrees of freeflcm froa 
their X values. 



' J Standard errors are in parentheses - 

0 Difference between black and white coefficient is si atisi ; --lly 
the p ^ .001 level. 
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Table A-l 



Description* of Variables in Wisconsin 
Model of LducaMonal Attainment: V!T 



SEL 



Abbreviation Descripti n 



Soc ioeconoaic Level: A summary index, con- 
sisting of six equally weighted components: 
father's occupational status; father's 
educational level; mother's educational level; 
number of rooms per person in home; number of 
books in home; checklist of other possessions 
in home. See Bachman (1970, Appendix B) for 
a detailed description of the construction 
and validity of this scale. 

Mental Ability: Factor score from a principal 
components factor analysis of three ability 
tests: 1) Anunons Quick Test of General 
Intelligence; 2) GATE, part of J-Test of 
Vocabulary Level; and 3) Gates Pending 
Comprehension , 

Acidcmic Performance- Respondent's report of 
Ins avenge qrade received *n his classes 
for th«2 pa»t year . 

Significant Others* Influence* An index com- 
puted on the basts of t 4 -o questions: "How 
d, these people feel about whether you 
should *a 13 college 1 "' and "What if you 
dv idvd not to go to college— how would they 
f«.i I *" A score of 3 wis given if the ret»pon- 
— _ - dwr.t-was h<*inri encouraged to_ alt and. cojl c^e 

aui tad feel trigs would result from non- 
Jtterian:*., a score of 2 was given if the 
re^ •onii.ni was being encourage;! but the 
i<_'eirenl wouldn't car^ if he or hhe dncided 
n ,t to attend, anl a score of I wis assigned 
if th* nspLindcir w.is ^ot being entourage J to 
a't,;rj cu!lf k . Scores tor question-- referring 
li« i-it!er, ro'htr, teacher anJ friend were 
sur,^«*d aad tV rf">ulunt composite Score was 

1 1 yc ' _,f FiMr-.tt lonal Aspirations. Thin index 
' ist ' un renpoufru!, io the quci>tiou r ru- 
git 'in^ ''ort raoge educational plans. A 
, f, c !. of " \" was assign d if the respondent 

\ \J dt in.tely pi mned to attend graduate or 

professional school, "2" if he definitely 



er|c 



Table A-l Continued 



Abbreviation 



* Description 



LEA (Cont .) 



planned to attend college, "1" if he definitely 
planned to complete high school, and "0" 
otherwise. 



LOA 



EDATT 



Level of Occupational Asp i rat ion a : Duncan 
prestige ranking for the occupation named by 
respondent in response to the question, "In 
the long run, what sort of work do you think 
you might do for a living?" 

Educations! Attainment: An index constructed 
by adding standardised scores for the follow- 
ing variables. 

a) Information about educational pursuits 
completed or in progress recoded into s 
scale ranging from "0" ihtve not yet 
completed high school or earned a high 
school equivalency), through "6" {have 
attended or am attending a graduate or 
professional school after college ) « . 

b) "How many years of schooling have you C 
completed?", and 

c) 'Vhat is the highest- degs >ou have 
earned'" 



LhA and w* r e v 
EI)A1 i i ?< hi t inn* ^ . 



"i c t ru* tci 
ard al \ ■ 



uMn t resj**'^* 1 * front titrv? 
! L( r wirnbli-1 from tine I 



4u 



Table A-2 



Means, Standard Deviations, and Pairvise Present Correlations for 
Variables in Wisconsin Model of Educational Attainment: 

YIT Data 























Valid 




SEL 


MA 


AP 


SOI 


LEA 


LOA 


EDATT 


X 


SD 


ri 


SEL 




.435 


.252 


.312 


.348 


.350 


.428 


509.74 7 


77.219 


1868 




. 467 




.482 


.313 


.331 


.469 


.492 


.154 


.801 


1912 


AP 


.058 


.247 




.264 


.377 


.403 


.510 


40.239 


7.431 


1904 


SOI 


,192 


.097 


,177 




.277 


.317 


.308 


5.680 


2.654 


1433 


LEA 


J 04 


.002 


.171 


.135 




.427 


.497 


1.401 


.770 


1623 


LOA 


.248 


.312 


.143 


.148 


.265 




.507 


59.830 


24.709 


1318 


EDATT 


.301 


.396 


,256 


.246 


.353 


.270 




.202 


2.891 


1359 


X 


4 4 ? . ° n 7 


-1.057 


38.254 


5.484 1 


.350 


53.282 


-1.431 








SD 


73.084 


1 .063 


6.463 


2.843 


.895 


24.674 


2.174 








Valid : 


?26 




255 




197 


181 


ll r 








Note: 


Statistics 


for blacks 


appear below 


the diagonal 


an . for 


whites 


appear above 


the diagonal. 
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Table A- 3 

Descriptions of Observed Variables in Model of Educational 
Attainment (Figure 3): NLS Males* 



Symbol 

in 
Figure 



Abbreviation 



Description 



XI 

X2 
X3 
X4 
X5 
Yl 

Y2 
Y3 



Y4 
Y5 



Y6 

Y7 
Y8 
Y9 



SES 

VOCAB 
PICTURE 
READING 
LETTER 
SLFCPA 

CPA 
FAEX 



hofx 

TCHISF 



PEEHPLAU 



EUASP 



EDSX 



ATTAIN 



Index of socioeconomic status resulting from factor 
analysis of father's education, mother's education, 
parents* income, father's occupation and household 
items. 

Vocabulary subtest score (standardized) 

Picture Number subtest score (standardized) 

Reading subtest score (standardized) 

Letter groups subtest score (standardized) 

Respondent's report of grades so far in high 
school , 

2 

Grade Point Average from school records 

Response to * question asking how much schooling 
respondent's father 'wants respondent to get. 
Responses range on a 6-point scale from "quit 
high school without graduating" to "go to graduate 
or professional school." 

Same as above, hut refers to mother 

Response to a Question concerning influence of 
teachers and counselors on college attendance 
Possible responses are, "discern*- agOO me," "didn't 
try to influence we," and "enc ;aged me." 

Respondent's report of his or her close friends' 
plans for next year. Coded "2" for college, "1" for 
vocations! t technical, business or trade school and 
"0" otherwise. 

Highest level of education respondent would like to 
attain, using sane response scale as for Y3. 

Highest level of education respondent plans to attain, 
using same scale as for Y3. 

Highest level of educnt ton training respondent 
attained by October, 1976. Responses range from 
finished high school through finished i'h.D. or 
advinced r»ro J essionai dc-t e. 



'Variables -1 through arc taken from the Ua^c ^cir questionnaire *ltiCh was 
MSrln Interest in 197: -hen ihe -itu.K-ntS ,crc ronior- '<> war: taken f rom the 

third follow-up que ■< t ionn lire whtch wt; adntn » ,:cr«,u fo»*r # ears later 

^This score was imputed from reports of actual >u i^"-. (letter or f.'ndt point average) 
and rank In class, 
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Table A-4 



ERIC 



Ntatw, St.nd.rd Deviations, and Pairvise Present Correlations for 
Observed Variable, in Model of Educational Attainment (Figure 3): NLS 



Males 





SES 


VOCAB 


PICTURE 


RfcADIKC 


LfiTTER 


SLECPA 


CPA 


FAEX 


MOEX 


TCHIHF 






.334 


.157 


.306 


.251 


.209 


.200 


.428 


.398 


.147 


VOCAB 


.253 




.253 


.647 


.428 


.410 


.450 


.405 


.407 


.226 


PICTURE 


.138 


.189 




.322 


.397 


.335 


.332 


.266 


.260 


.188 


READING 


.220 


.611 


.298 




.532 


.423 


,458 


.420 


.419 


.264 


LETTER 


.225 


.402 


.372 


.548 




.392 


.412 


.375 


.362 


.255 


SLFCPA 


.086 


.173 


.168 


.257 


.212 




.706 


.394 


.396 


.286 


CPA 


.082 


.238 


.253 


.321 


.314 


.503 




.386 


.389 


.277 


FAtX 


.310 


.269 


.170 


.323 


.339 


.170 


.179 




.910 


.361 


MOEX 


.328 


.356 


.187 


.390 


.360 


.182 


.216 


.838 




-357 


TCHINE 


.out* 


.141 


.083 


.192 


.189 


.167 


.1?" 


.135 


.236 




PEhRPUN 


.185 


.260 


.178 


.221 


.218 


,108 


..40 


.232 


.274 


.164 


ro\sp 


.2 39 


293 


.227 


.356 


.324 


.236 


.190 


.513 


.485 


.162 


EDf.X 


.280 


.348 


.135 


.381 


.327 


.304 


.246 


.529 


.562 


.205 


ATTAIN 


.266 


.319 


. >14 


.346 


.3*5 


.241 


.31'* 


.3/2 


.390 


.205 


X 


-3.949 


42.078 


44.086 


42.04? 


40.906 


4.901 


5 o46 


4.283 


4.328 


2.683 


SD 


5.886 


7.334 


9.250 




10.477 


1.287 


£.902 


1.308 


1.291 


.545 


Valid N 


1J36 


859 


859 


859 


859 


124<- 


1032 


757 


893 


901 



PEKRPLAN ED ASP EDEX 



.338 
.338 
.221 
.330 
.321 
.321 
.313 
.448 
.451 
.268 

.353 
.371 
.280 

.963 
.954 
1207 



.360 

.379 
.237 
.402 
.331 
.405 
.384 
.684 
.682 
.320 
453 

.566 
.409 

4.64 5 
1.338 
378 



.424 
.411 
.273 

.436 

i 

.370 
.477 
.456 
.748 
.739 
.314 
.507 
.732 

.429 

4.047 
i .406 
4^8 



ATTAIN 


X 


SD 


Valid K 


.409 


1.030 


6.717 


8532 


.424 


51.659 


9.699 


6205 


.293 


49.6*o 


9.730 


6205 


.422 


51.548 


9.497 


6205 


.375 


50.662 


9.427 


6205 


.447 


5.389 


1.423 


7943 


.450 


7.082 


3.047 


6544 


.561 


4.354 


1.251 


6544 


.547 


A. 417 


1.222 


6671 


.267 


2.612 


.543 


6411 


.452 


1.258 


.933 


7606 


.544 


4.853 


1.274 


4572 


.646 


4.215 


1.384 


4991 




3.309 


1.953 


7658 



2.709 
1.825 

no6 



Statistics 



for black, o P ,*a below the fUfWtl f»t -»•"*« -P»«r *«ve the diagonal. 
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